"Anarchy" Reigns: A Quantitative Analysis of Agent-Based Modelling Publication Practices in JASSS, 2001-2012

Agent Based Modelling (ABM), a promising scientific toolset, has received criticism from some, in part, due to a claimed lack of scientific rigour, especially in the communication of its methods and results. To test the veracity of these claims, we conduct a structured analysis of over 900 scientific objects (figures, tables, or equations) that arose from 128 ABM papers published in the Journal of Artificial Societies and Social Simulation (JASSS), during the period 2001 to 2012 inclusive. Regrettably, we find considerable evidence in support of the detractors of ABM as a scientific enterprise: elementary plotting attributes are left off more often than not; basic information such as the number of replicates or the basis behind a particular statistic are not included; and few, if any, established methodological communication standards are apparent. In short, 'anarchy reigns'. Whilst the study was confined only to ABM papers of JASSS, we conclude that if the ABM community wishes its approach to be accepted further afield, authors, reviewers, and editors should take the results of our work as a wake-up call.